Systematic Series Expansions for Processes on Networks 
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We use series expansions to study dynamics of equilibrium and non-equilibrium systems on net- 
works. This analytical method enables us to include detailed non-universal effects of the network 
structure. We show that even low order calculations produce results which compare accurately to 
numerical simulation, while the results can be systematically improved. We show that certain com- 
monly accepted analytical results for the critical point on networks with a broad degree distribution 
need to be modified in certain cases due to disassortativity; the present method is able to take into 
account the assortativity at sufficiently high order, while previous results correspond to leading and 
second order approximations in this method. Finally, we apply this method to real-world data. 
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Historically, high temperature series expansions played 
an important role in the development of the theory of 
critical phenomena on regular lattices 1], showing non- 
classical critical behavior and giving the first hints at the 
concept of universality. The success of these methods is 
remarkable when one considers that accurate results near 
the critical temperature require taking into account crit- 
ical fluctuations on all scales. Such results were obtained 
by the ratio method, Pade approximantsQ, and other 
means of extrapolating a series of finite length. 

In this Letter, we apply series expansions to systems 
on networks. One expects the results to be more accu- 
rate at a given order on network systems than on regular 
lattices because in many cases these critical correlations 
are absent. On scale-free lattices there are no critical 
correlations due to the absence of a spatial structure [3|]. 
On a small- world networkQ, there are correlations de- 
termined by the regular lattice up to a certain scale and 
then mean-field correlations beyond. In the limit of a 
small density of long-range links on the small-world lat- 
tice, the correlations on the regular lattice lead to an 
anomalous dependence of the mean-field amplitudes on 
the link density 0. For a large density of links, the mean- 
field behavior takes effect beyond a short scale, and thus 
we expect even a few terms of the high temperature series 
to suffice for accuracy. 

Further, the series expansion method includes non- 
universal effects including details of the lattice structure. 
We will mostly focus on locating the critical point where 
we see that the series expansion method provides quan- 
titatively accurate results that can be systematically im- 
proved by going to higher orders. Historically, series ex- 
pansion methods have provided some of the most accu- 
rate results for critical exponents 0, so on this much sim- 
pler problem we expect that high temperature series can 
be more accurate that direct Monte Carlo simulation. 

We begin by developing the series expansions for equi- 
librium problems, focusing on an Ising model as a defi- 
nite example, and then develop the series expansion for 
non-equilibrium problems. We will see that many of the 
commonly accepted results for the critical point appear 



in the leading orders of the series expansion, while higher 
orders can significantly change the location of the critical 
point due to disassortativity in certain networks^]. 

We are aware of one previous use of series for network 
problems^, for bond percolation, equivalent to certain 
models of epidemic disease. In this case, an exact relation 
was developed between the susceptibility of a regular lat- 
tice and the critical point of a small world network, and 
the susceptibility was determined using series expansion. 
We show that for a class of problems which we term "fac- 
torizable" similar exact relations can be found on small 
world networks. For example, we exactly locate the crit- 
ical point in the Ising model on a one-dimensional small- 
world network. The final result in this Letter is to show 
that the series expansion can be applied directly to an 
arbitrary real- world network with accurate results. 

Equilibrium Problems — We consider an Ising model 
on a network as a typical equilibrium problem. We set 
all bonds to the same strength for simplicity to study 
the effect of network structure. We leave the network 
structure completely arbitrary here, and later give the 
results in certain special cases of the network structure. 

The partition function is 



Z = exp[J//cT 
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where the sum is over nearest neighbors i, j on the given 
network. We locate the critical point by calculating a 
high temperature series for the susceptibility, defined by 
X = (kT)~ 1 N~ 1 j ((JiCTj) where N is the total number 
of sites. The susceptibility series is well-suited for locat- 
ing the critical point because it diverges as (T — T c ) _1 [3 
in these models, while the specific heat shows a jump at 
T c but gives no divergence above T c . 

Following standard techniques of high temperature se- 
ries expansions 0, we calculate \ t° fourth order: 

kT\ — 1 + wrT\ + w 2 ji2 + (2) 
w 3 n3 + w 4 (ru — nK) + 

where w = tanh( J/kT) and where the numbers nTn char- 
acterize the network by giving the average over all sites 



i of the number of self-avoiding paths of length m con- 
nected to site i. Thus, nT = k = N^ 1 fcj, where ki 
is the connectivity of a site i. One may see that IT2 = 
k 2 — k = Af _1 ^.(fcf — fcj). The number rt 3 is equal to 

JV ~ 1 E< A fci<ij> 1 < J -,*>,i#fc 1 i the sum over triplets 
such that i 7^ fc and i, j and j, fc are pairs of nearest neigh- 
bors. We define nK = N' 1 E W)fc;<i)J>i<jjk>i<i)fc> 1, the 
average number of length-3 closed loops. Thus, for a 
plane triangular lattice, jia = 12. 

The simplest method of extracting the critical temper- 
ature is the ratio method: given a series J2 n a nW n given 
by Eq. we approximate the radius of convergence, 
and hence the critical w, by by a n /a n —i. The first ra- 
tio, ai/ao = fc, giving uj -1 = k, and for A: large this 
reduces to kT c w Jfc. The second ratio, 02/01, gives 
= k 2 — fc/fe. This second result is the commonly 
claimed result Q for the critical point, improving on the 
naive result k. We will see, however, that even higher 
orders in the ratios significantly modify this result by 
including effects of assortativity. 

A better method of extracting the critical tempera- 
ture is by means of Pade approximantsQ- We write a 
series with a finite number of terms as X)ni? f o, n w n — 

E^oW^J/Ejlo©^] + ° wL+M+1 - The above se - 

ries with four terms can be approximated by an L = 2, 
AI = 2 Pade approximant. The closest singularity is at 

_j — a- 2 a 3 +a 1 a4 1 + \J (a 2 a 3 — 01 04) 2 — 4(0204— a|)(ai a 3 — a|) 

2(a 2 a 4 — of) ' 

Illustration — We now apply these results to a simple 
class of networks with a broad, but finite, degree distri- 
bution and with nontrivial assortativity. We designate 
each node with probability p as a "high degree" node, 
and with probability 1 — p as a "low degree" node. For 
each high degree node, we assign m connections from 
that node to other, randomly chosen, nodes. If two 
nodes become connected more than once via this pro- 
cedure, we give them only a single connection. For N 
large, a low degree nodes has a Poisson distribution of 
links, with average degree pm and a high degree node 
has k links where k — m is chosen from a Poisson distri- 
bution with average pm. Thus, nT = 2pm, = k 2 — k = 
3p 2 m 2 + p(m 2 — m), 713 = 4p 3 m 3 + 4p 2 (m 2 — m)(m), and 
TT4 = 5p 4 m A + I0p 3 (m 2 — m)m 2 + p 2 {m 2 — m) 2 . 

For p small and m large the degree distribution be- 
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comes very broad and n\ 
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ical point yields a series of approximations: a±/aa ~ 
2pm, 02/01 i=a m/2, 03/02 ~ 4pm, 04/03 ~ m/4, and so 
on, with an obvious alternation from term to term. Us- 
ing the Pade approximant, we find in the limit pm >> 
l,p « 1 that 



kT c « 



(3) 



This result © for T\ 
ratio result, kT, 



is far below the second order 
Jk 2 — k/k for the given limit. The 
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FIG. 1: Specific heat (solid line) and average of absolute value 
of magnetization (dashed line) for Monte Carlo simulation 
of 16384 spins. Pade approximant predicts critical point at 
kTc j J = 41.46, shown as vertical dotted line. 



physical reason for this difference is the disassortativity 
of the given network. The high degree nodes connect to 
other nodes chosen at random, which are most likely to be 
low degree nodes. In the given limit, most of the paths of 
length 2k consist of a path that alternates between high 
and low degree nodes, and thus there are of order p k m 2k 
such paths, while there are only p k m 2k ~ 1 paths of length 
2k — 1. 

Following 0|, we measure the assortativity of the net- 
work via the connected correlation function of remaining 
degrees at the end of a random edge. This quantity is 
equal to 



(n 3 + n A )/ni - (n 2 /ni) 2 



(4) 



Thus, on a network with vanishing assortativity and no 
length three loops, the ratios 03/02 and 02/01 are equal. 
If the higher order ratios, a n /a n _i, are also equal then 
the critical w^ 1 is correctly given by na/nf. 

In fact, the Pade approximant method is capable of 
yielding highly accurate numbers for specific systems 
even at this low order if the degree distribution is broad 
enough. We choose the specific case of p — .1, m = 1 00 
so that nT = 20, = 1290, ni = 43600,7^ = 2020100. 
The ratio method gives the series of different ratios for 
the critical w^ 1 : 20,64.5,33.8,46.33, which show alter- 
nation from term to term but appear to be converging. 
The Pade approximant puts the critical temperature, 
T c = 41.46. We show in Fig. 1 curves for the specific heat 
and averge of the absolute value of the magnetization for 
a Monte Carlo simulation of 16384 spins on the given 
network. It can be seen that the Pade result is very close 
to the correct critical temperature, while the first and 
second ratio results kT c /J w 19.98 and kT c /J w 64.49 
are poor estimates. 

Exact Results in High Temperature Regime — In some 
cases, the high temperature series can be used to ex- 
actly locate the critical point. For the specific network 
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discussed above, in the limit of large N the loops in the 
network become very long and thus looplessness is a good 
approximation. One can show exactly that in this model 
n/T ~ (pm + -J 'p(m 2 — m) k . In the Ising model, if the 
network is loopless, then the susceptibility series becomes 
kTx — J2k wk ^ki an d thus the critical point is located 
at w—l ~ lim/c^oo rife 1 /' . In fact, this result precisely 
agrees with the Pade result above, so that the critical 
point located above is exact. 

A second class of problems for which one can find ex- 
act results for the critical point consists of certain "fac- 
torizable" models on small- world networks constructed 
according to the following procedure: one starts with a 
regular lattice in d-dimensions, and then adds long-range 
links, connecting any given pair of nodes with probability 
p/N. Consider the high temperature series expansion of 
an Ising model on such a network. At any fixed, finite 
order of the expansion for kTx, the only loops which ap- 
pear in the limit of large N, are due to loops on the local 
lattice 10], with no loops due to shortcuts. Then, the 
ensemble average of the susceptibility in the high tem- 
perature regime on the small-world network in the large 
N limit is exactly given by 

kT X = kT X o(T)/[l - ptanh( J/kT)kT Xo (T)], (5) 

where xo (T) is the susceptibility at temperature T on the 
local lattice with no shortcuts added. This is the same 
kind of result found in || , and such results can be found 
for percolation, Ising, and Potts models, as well as the 
SIR model, but not the contact process or Heisenberg 
model where the series expansions can involve multiple 
crossing of the same small-world link. Similarly, models 
such as diffusion 6] on a small-world network again do 
not have such an exact result because the model of dif- 
fusion in the absence of long-range links does not have 
a meaningful series expansion due to the presence of an 
infinite correlation length. 

Eq. 10 accords with the mean-field theory 
result |3- It locates the critical temperature of the 
one-dimensional small-world Ising model exactly: 
ptanh( J/kT) exp[2 J/kT] = 1, so that for small p, 
kT = 2J/log(p- 1 ) + .... 

Non-Equilibrium Problems — We now consider non- 
equilibrium processes on networks. The power series for 
these processes can be calculated just as for equilibrium 
processes, although the combinatorics are slightly more 
difficult. We consider the contact process|llJ and SIR 
model 12]. In the contact process, sites are labeled ei- 
ther susceptible or infected, and an infected site can in- 
fect susceptible neighbors at rate A, while it can recover 
and become susceptible with unit rate. In the SIR model, 
the infected sites become removed, a third state. Once a 
site reaches the removed state, that node can no longer 
become infected or infect its neighbors. 

In the contact process, we start at time t = in a state 
with all sites susceptible and one site infected and then 
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Xsis= / diV ni ((), (6) 
Jo i 

where rij is the probability that site i is infected at time t, 
averaged over all possible different initially infected sites. 
This quantity xsis diverges at the epidemic threshold. 
One finds to second order 

Xsis = 1 + AnT + X 2 n^ + ... (7) 

For the SIR model, at t = oo all nodes are either sus- 
ceptible or removed with no nodes susceptible. We define 
in this case xsir to be the average number of removed 
nodes at t — oo averaged over the same set of initial state, 
giving 

Xs/i? = l + ArTT+A 2 (ni-nr) + ... (8) 

Finally, we consider bond percolation, which is related 
to, but not identical to, the SIR model, and in fact has a 
different series expansion. Bonds are active with proba- 
bility p and we define Xperc to be the average number of 
sites connected to a given starting site. Here 

Xperc = 1 +pni+p 2 n2+p 3 (m -nK) + (9) 
p 4 (ru- (3/2)nf5 - 2WaJ) + 

where nu = N 1 J2i,j,k,i;<i,j>,<j,k>,<k,i>,<i,i>,i^k,j^i •*■> 
the average number of length-4 closed loops, and where 

n A,l = N 1 Y^i,j,k,l;<i,j>,<j,k>,<k,l>,<l,j>,ijtk,ijtl 1- 

Thus, for a plane square lattice, no = 8. 

At higher orders, the detailed series for these three dif- 
ferent processes show differences, but the dominant term 
will be of the form X k (rTk + ...), so that if the network 
is highly connected with rik >> Tik-i, we can locate the 
critical point at A ~ lirm-^o^nfe-i/rifc). Thus, the same 
results as in the Ising model case for the effects of assor- 
tativity occur again here. 

Epidemics on Real- World Networks — We now con- 
sider the dynamics on real- world networks. We consider 
bond percolation as a version of the SIR process on the 
283 node connected component of the web of romantic 
relationships at "Jefferson High" 13]. Shown in Fig. 2 
is the results of simulation as well as the Pade approx- 
imant results. We include the [0, 1] Pade approximant, 
Xperc ~ 1/(1 — pnx), as well as the [1,1] approximant, 
Xperc ~ [1 + (nT - n2/nT)p]/[l ~ (n^/rn)p\, as well as 
the [2, 2] approximant to the fourth order series ©• The 
[0,1] and [1,1] results give the standard results for the 
critical point, while the [2, 2] approximant is seen to be 
much more accurate. 

We believe that the difference between the [2, 2] ap- 
proximant and the simulation is in fact due to finite size 
effects. Differences set in only when a sizable fraction of 
the network is on average part of the percolation cluster. 
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FIG. 2: Susceptibility of bond percolation on social network. 
Solid line is from simulation. Dashed lines are (from left to 
right) [0, 1], [1, 1], [2, 2] Pade approximant results. 



FIG. 3: Susceptibility of bond percolation on simulated net- 
work. Solid lines are (from left to right) from simulation of 
10000 and 1000 nodes. Dashed lines are (from left to right) 
[1, 1], [2, 2], [0, 1] Pade approximant results. 



We believe that if larger social networks were obtained, 
of the order of the number of people in a typical city, the 
[2, 2] approximant would become highly accurate. How- 
ever, it is difficult to get large data on accurate social 
networks to test the series technique against simulation. 
In fact, this is precisely the reason for using the series 
technique: it allows one to obtain accurate results from 
local data. 

Thus, to illustrate finite size effects, we return to the 
network defined in "Illustration", taking p = .2 and 
m = 10. We find the results shown in Fig 3. The [2, 2] 
approximant is again found to be more accurate, and it 
is seen that the simulation of 10000 sites is closer to the 
Pade result than the simulation of 1000 sites. As before, 
in fact, the Pade predicts the exact result for the critical 
point on this network in the infinite size limit. 

The Pade result above can be determined for any net- 
work such that we can find the various constant tii, n,2, 
This can be determined based on local information and 
Monte Carlo sampling of a small portion of the network. 

Discussion — The series expansion technique pro- 
vides a systematic method for studying networks in 
the "high-temperature" phase. It is possible to extend 
this technique to include the ordered phase. For ex- 
ample, in an Ising model one can compute the par- 
tition function as Z = (exp[ — J /kT^2<i j> — 
Y,ihm])h = ^p{Y,n( 1 / nl )((- J / kT T, < i,j > ( ri<7j ~ 
J2i hiO~i) n )h,c]i where the expectation value {■■■)h is with 
respect to exp[+ hiVi], and {■■■)h,c denote various 
cumulants. Keeping only the first cumulant, setting 
hi = h(ki) for some function h depending only on the 
local coordination number, and maximizing Z over h re- 
produces previous results |3j, while corrections are found 
at higher order. 

The technique provides exact results on certain sys- 
tems, such as loopless networks and certain problems on 
small-world networks, where it agrees with, but goes be- 
yond, previous mean-field calculations. It works well on 



simulated and realistic networks. In many cases, only 
local information on a network is available. A tendency 
has been then to construct a model which agrees with the 
local information, such as distribution of connectivities, 
and then simulate the desired process on such a simu- 
lated network. Series expansions instead directly express 
the desired result in terms of the local properties. One 
key result is the quantitative measure of how the assor- 
tativity affects the critical properties. 

Acknowledgements — I thank M. A. Moore for useful 
discussions on the application of series expansions to crit- 
ical phenomena. This work was supported by DOE grant 
W-7405-ENG-36. 



[1] C. Domb, The Critical Point (Taylor & Francis, Bristol, 

1996), p. 148. 
[2] G. A. Baker, Phys. Rev. 124, 768 (1961). 
[3] A. V. Goltsev, S. N. Dorogovtsev, and J. F. F. Mendes, 

Phys. Rev. E 67, 026123 (2003); M. Leone, A. Vazquez, 

A. Vespignani, and R. Zecchina, Eur. Phys. J. B 28, 191 

(2002). 

[4] D. J. Watts and S. H. Strogatz, Nature 393, 440 (1998) 
[5] M. B. Hastings, Phys. Rev. Lett. 91, 098701 (2003). 
[6] B. Kozma, M. B. Hastings, and G. Korniss, Phys. Rev. 

Lett. 92, 108701 (2004). 
[7] M. E. J. Newman, Phys. Rev. Lett. 89, 208701 (2002). 
[8] M. E. J. Newman, I. Jensen, and R. M. Ziff, Phys. Rev. 

E 65, 021904 (2002) 
[9] D. Jasnow and M. Wortis, Phys. Rev. 176, 739 (1968). 
[10] C. Moore and M. E. J. Newman, Phys. Rev. E 62, 7059 

(2000). 

[11] J. Marro and R. Dickman, Nonequilibrium Phase Tran- 
sitions in Lattice Models, (Cambridge University Press, 
1999). 

[12] P. Grassberger, Math. Biosci. 63, 157 (1983). 
[13] H. Bruckner, A. Martin, and P. S. Bearman, Persp. on 
Sexual and Repr. Health. 36 (6), 248 (2004). 



